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ordering. Occas.cna«v,sV 



0 



including 

woot/4«5i ^ exc\ud»n9. 
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p^vids a mo« effioien.. con.em-based algorimm. „ would .,so be desirable 
'o p^vlde dffleren. .ypea cr p,ed,c«va algonthnns, .hereby .ncreas.ng 
predictor, accuracy, in addiilcn ,o assigning overall ralings to programs .. 
luid be a graa, advantage lo provide ^ user w„b *e capab,,,,, o. raung 
individual program features, such as the actors or the director. 

f Herz, J. Eisner, L. Ungar. M. Ma,.us, System for generation of .ser 
nrofiles for a sysTem for cu^on^^er, e,ec,ron/c ,*n*a,»n o, des,rab-a 
" S. Paten, No. 5,754,«39 (May 19, ,993) describes a client serve. 
baLd syslen, tor retrieving »en,s o, interest to a user. An interest surnmar^^o 
the user is prepared, b, querying the user about their .nterests. Each targe 
l availa >e over the networK is descdbed by a target prolile Targe, 
"otiles are compared .o each other and clustered according to s,nn ar y^ 
Clusters and individual target «ems are compared with the user in.eres 
summary. Items liKaly .o be o, Urteres. to me user are presented ,n a ranked 
.ing L user protile is stored on a proxy sewer, and secunty measures 
^provided .o safeguard «,e use.s identKy. Relevance teedbac^ ,s 
provided by moniloring which items a user expresses interes. ,n. Whrle 
els are made .o preserve «,e use.s con«den.ialily Ihrough vanou 
, fecunty measures, it wou« be desirable to provide a sys.em ,n «h,ch he 
urs profile is s.or«d locally, on me client side, and commun,cat,on 
betwee the serve, and .he citon, is slateiess, so that the se.e 
completer Ignorant o. .he use.s ^n..y. I. would also be de.rab^ o 
prol a prediCion engine on the client side, again rendenng a stale. 
,5 lnec»on beween ollen. and server unnecessa^. In addi.icn to ,mp ^ 
relevance feedback, i. would be an advantage to allow ,he user to correct 
«,eir proflle, thus allowing even greater predicive accuracy. 

O. Graves. B. O'Conner, A. Barker, A^.r.us .nr. ma,W o, so,C., v«eo 
,0 programs .ased on vle«e,s preferences. U.S. Pa.en. No. '-^'O-^'^"^ 
25 ,995) describe a method for selecting television programs according o 
eLesJd Viewer preferences that employs an adaptive prediction 
Television programs are described in temrs o. attributes. A vrewe, 
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on ,hese exp«ci, viewer «..ngs, a neum. new."^ 

programs with a high enough score are ,, 
..a.e..,n»...e.esc*e.™..^.----^^^^ 

i-rprrrrazrpro:,^^^^^ »^ - 

robustness. 

, ,e,.0 (Feb^arv 26, ^^^>^^,^ ^ , ,„„o„er ,ro. .hs >nven.o^ in 

filter... 3 algomi.... svstem to rate movies they 

3 Vide. stor.. -^e customer uses a scalar a^ svs. ^^^^^ 
.avev,.«e<..The,esu«ingpror,>e,spa,.dw..h^^^^^^ ^^^^^ ^^^^^ 

(Mst a port on of those seieuiiu 
have raled a. leas, a p ^^^^ ^, 

3 cus.on,er, and an ;='^;„„,,„, ous.omers Is de.lned lor 

Based on '-^^ P^^^^J^^, *,a, Worma./or, .a„ve,v 

.,e «,s. cus,om . °- J^^^^" 3 ,^.^35 ,;,„,„^4. ,998, descnbes a 

,l,„a, lnlor,na,lon ^^""^^ ^^^.^^ algorl.hn, predics con.en. 

20 digital iransport syster,.s. A collate „ Y Lashkan, 

D. Tiu, M. Melral, J. cc,/tebo,a(,Ve ffllar/ng and fea.^re- 

racon,mend,ng .«ms us,ng .ffpaten. No. 6.092.049 (July 18, 

„ 'aOOO) descdhs a method - I^^Hhed. a conven.lona, 
oollaboralive TOerlng. As «*h .he -'^^^ ,0 Cher 

collaborative filtering implemenlation. m v,n, 

method and arf/cte 

users, is provided. B. Miller, J. Konstan^ u. S. Paten, 

— system 

30 NO. 6,108.493 (August 22. 2000) .oHaborative liUenng 

utilizing collaborative Wlers. described system 

,„plen,en.ations, which operate on -^-^^^^ ^^^^ ^ 

„,ifees implicit measures. The accuracy 
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v.o..««« . he QUile high. NeveXhele^'^' 

. „ has been sho-n » be ^" ^,i„,„„,„, 
collabo,a,We «»enn9 illlertn, W'«'<»"'»«°i: lea*, » conoen>s 

„.e. io.on.a«.n in -;^';;3,,„en«y, ,o a oollabo-aliva 

ai^ullheuse^sp-wa^-^ ^^„„,,^aesi.able o P^^^^ ^^^^^ ^, 

'r:*:--.o.e«han.n,.a.e 

„wi„a items to a user, O. ■ 
and method for ,or recommendin, 

O. v«i»e>s. system m ^..rtbes a sv^^m ^ 

Pa.en,No.5.7*«.0B^ t . -^'o- ^"^"^ ™ ^nt -.-P"— '""^ 
,e.s o. .netchan*se 'o a .^^fl^ 

.ueaay -'«*^ j:lissvslen,co,te,a,es^> - ■ 
aescribed above, ^ „, »ems ooou, 

pu^hase. Based on *e „„„amv b and ,e 

3ca.c.>Utedma.i..a.en>o ,^„.,3i«>ie and eas,lvJP 
^ «,e pair. ^« <'^=^"'= ' , ^. However, since ^ e 

U suned .or P°-° toouned in ^ same pu-^as • ^ ^^^^ ^^^^ 
simpW on ^ '2^1 o, simiiarily. Fo, examPle^ ^ 

.ene.1 aPP'o-^-^^. He children and J^^^V ^ , ^^.^^ 

«,,e. in Ihe P"-"-^^,,,„, pair » * ""-"tT Uvan,age to «ner *e 
pair, aibeil awealdy «ould be J 

...n.,o.-.-rjrrr.^^^^ 

computer program P^o ^ 
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..,.a......^a«»^— ^^^^^ 

«eHng a,e p,ovided, bo* very hlgh-y w»h *e,r 

preferences. There are lnd«.dua. .„ ^.en^heWngly 

:Un«a, .unoon o, ^V^.- a«<« . .ys,en.. -.e 
one c, ex*e>on. wUh *e — "^^^pea. ,o a user, and sua,es. 

items UKeW .o appeal ,o a user *e redu ^^^^ ^^^^ ^^^^ ,,,, 

.„...ree.s.sa.ed..ea.^^^^^^^^^^^^^^ 
- — "din en,nes .a. are capaHe c 



accord., .0 .c« mu* « - are capaHe c, 

,dvan,agsous .0 provide '^^J^'^ .en,. « would be 

prov*, -he mos. accurate p.ed«»^n «« a P^^_^^^_^^ ^^^^^^ ^ 
K,9H.V desirable .o P-ovWe ^^^^J^e , would be an advantage .or me 
Jsten, me use.s preferences. ^'^"^^^^^ and adapt to sblKs 
.Unrtobaveanadaptwecapab*.-*^'^ ^ ,,3,rt«ed 

,„ user preferences. ^ -"'^^Jl^ a use.s privacy by elirninatlno 
,0 oollaboratKre filtering ermine tb^ ^ara ^^^ ^ ^^^^^ ^ „ 

,he necessHy of correlabng «.e use Jo ^^^^ ^3„ 

«uld be a great advantage to ca--^^^ J ^^^^ ^^^^^^ ^^^^ 
.etween users and to pertorm --"^^^ and ^ cl«... » 

,he necessity of a statefu. connection be^ ^„ ^.^^.^e 

« louid be a -^^^^^^^^^^ 

modeling prediction engrne tba. a^ep » 
„e capability o, Inferring user J. ngs^ ^^^^3 p„ 

would be a great convenience to drsplay 

engines ma single, integrated list. 
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. „««o-k-based intelllgem system and method (or 
The invention provides a netwo ^ 
predicting rating .or items o, me^a ^^^^^^^ ^„„,,„„«,, 

item. 

programming. '"*-dua. 'e~' - is provided in wh.. the user 

,3 communication with a -.ven A „ ^„,„,,„,,s. Using an 

teaches «.e system l,y recording tne,r » 

■ rating system that employs a thumbs k 

.„.nrable ratings, respective. 

a urogram, or th^" . -ate ma. 
users n.ay give «. "erall ^^^^^ ^^^^^^ g^^^es- provided 

20 features of the program: for examp e - .^^^^^ 

in interactive lists. The users preferences. 

more predictive algorithms. 

V, H in which individual items are 
A collaborative filtering algorithm .s pr ^^^^^ ^^^^ correlating users 
25 correlated to each other, ir^stead ot J individual 

. each other. Lists of rated items ar P^ ^-1 V J ^^^^^ ^^^^^^ 
Clients to the sender. The ratings are ex ^^^^.^^ ^^.^^^ ^^^^^ 

matrices on the server, ^j-^^^^^^^^^ providing an important 

information on the sender. .actors for pairs of 

30 privacy safeguard. The server ompu ^ ^^^^^^^^^^ .^^^^^ 

programs and P--^^^^^^^^ programs already rated hy the 

client searches the table for pairs 



PCT/US00/33S76 

WO 01/47257 

. not rated by the user, which correlate to the rated 
user Thus, other programs not rated oy 

^or. hf» assianed a similar rating, 
program, can oe assjyueu 

. „ ...» . ■^sr:'."::''-^'^"'^' 

algorithm is also provided that works by y preferences on 

, on previous ra.nas u^r o P 9 ^ ^^^^ 

features. Based or, the rnferted ^„„entional implemsntaiorrs 

™* - :",::'"rrer extend .a eaves a„or«trn, to 

-:tr;r::rr::::::.^^^^^^^^^^ 

preferences, with infenred ratings. 



more clr^c-'" 
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-■•-■T;rr.r,'rr:rrrr::. 

according to the invention; 

interface to the system of Figure 1. 
Figure 2 shows a screen from a user .n e _^ ^^.^^^ ^ 

.herein suggested items are displayed to a user. 
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according to the invention; 

5 according to the invention; 

. H ^ .how screens from the teaching interface of Figure 2 for 
Figures 4 and 5 show screens 
teaching content category and sub category p 

invention; 

u- « • ^rp of Fiaure 2 for teaching 
o crreen from the teachin^^ . .c*ce ot t-tgur 

actc -refr -es,. -ording to .-^nlion; 

7 Shows a screen ho-n *e teaching mtertace o. Figure 2 tor co^ecting 

program preferences, according to the invention; 

and 

4 o H-.Qtributed system collaborative 
Rgure to Shows the biocK diagram o. -J^"^^^ ^^^^ ^ 
,5 filtering prediction system, within the system of F,gure 

invention. 

50 ^. , js a block diagram of an intelligent. 

Referring now to F.gure 1. shown ^^^^^ 



one sVotted in 

capabWV- P^®"*"" -me preferred metn user 

.ssed preferences. The P .^^^3 ,aied ^^^^^ ^^.^s 

^'^P^' le tWer^ng engine 17. V- ^^^^^^^^^.^ h ^^^^^^^.^^ 

^« ^^"^'C.o.heserver.1,-^-^^^^^^ ^'^7;o ..ere tV.e 

•,niorr.a\»on irorn ,,ansrn»tted ^„ t^e 

is generated ia . rawgs 

event, an adap>w«. »,e conten ,„ * 

® ram rtems. P^®' <pawres as »np" y^jch 

^orated P<o9«'" ^ ^nous P'-^'^" '"^'iBer inters ""^ 

and sotware eng 

rtc TeACH\N<^ »^ revels). 
,3, ,V^,en, a«o«s use. » « -""f «P" 

Batings are ei^y 
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,„aica.e mvorabla ratings and m"-^ „e use, 

indicated by an absence o. ^ depressing a bu«on on 

assigns thumbs to a p«>9'am o, a ptog ^^^^^.^^ 2, , 

a remote centre, .bat rs prevrded v^b .be ^ ^^^^^ ^ ^^^^^ 

suggestion screen ao c, •"';'^f;^tons 22. Oose to tbe top o. tbe 

programs 21 accompanied by -""^ over a menu item 

Leen. benea«t*e banner, a seie^cnba P ^, 

23 «.a. gran.s access to tbe ^^^^Z^ °* """""^ 

.ispiayed in a descending son , ^'"-^ °' 

, 3,ro«-sbaped cursor 24 ^'X-l-^^^^;^ ^.^^n 30 o. a user intedace 
suggestions. ^-"^^"^'""^"^^^ and individual program .eatures 
,or assigning ratings .o,e,ev>s«>n program ^^^^^ 
, sbo«n. setections to, raW P;^--J^^,,X, user manipulates 
pmgrams 32. actors 33 and ~ ^ ' . p,„,„ed remote control. As 
„ ;e various inteHaoe etements ^ J - - 3,, „aV^ates tbe 

,,,u,es 4 and 5 sbow. seieCrn, .be teacb g ^ 

„3„ ,0 a .eacb category ^'^^ ^J^^^^^ ,,splayed categories or sub- 
categories screen 50. Se-ectrnganyj ° ^^^^^^ ,^ . 

categoHes allows tbe user ° ^^'^ ,ad,awn to reflect tbe 

,„ categories, altbougb .be option 33, .be use, ,s 

use.s ra.ings. Upon ^-^r^^^ o, wbicb are sbown in Figu«s 6 
presented witbseve.1 pre.erences, expressed as ra,.,9S. 

and 7. AS previously indicated, ^^'^ ^.^oritbms o. tbe inventron. 
are necessary as input - '^^J^;^^,,,,^ ,be use, wHb p,edic.ive 
„ Be.o,e .he aigonthms are abie to^a P ^ 

ratings, .bey mus. be -^ughf °' — ^ „ ^.^oVrng a program .or 
preference data. In the course "' J ^.^^^am. By assigning ,a«ngs rn 
Recording. v,e«e,s may assign a ra., g P 9^^_^^ ^^^^ ^ 

„is way. however « can «.ko ^ '^'^ p,edic«ve a.gon,hms. 

30 da.abase has accumulated --^3 Taccumula.ing preference daU., .he 
,„ order .0 accelera.e .he pro«ss c „ay 

.a,ious .eaching -'^^^T^^^ ^ '^^^ 
ini.ia«y go through the Irsts V ^ ^ 
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...... — — . - — ;:::rr:::r: 

L.,. - -c-ir'aTrrrz. o. ....... 

'Teach famous actors screen p facilitated. 

Addttionally, a -Teach a» actors ^^^^ ^.^^^^ 6 
eon,p.ehensWe .«o. actors., cm «h,ch me , 

S.OWS .He .nanne. o. ass.™n« ^^^s. . ^^^^ ^ ^^^^^ 
„enu o. possib.e ratrnfls 62 horn «h 

ocrresponain. aCor. A«er se.e^«9 ^„„e<f,a.e„ 
WgWigWed. AS previously descnbed. the user 
r^a,n.e<..ore.,eC,heuse.sra«nsse,ect,on- 

. screen 70 is shown. While the example 

,„ Figure 7, a ■CorreC ra.ed aCors sc ee" 

.Hown indites .hat no actors ^^ ^^^^^^^^^^ ,o ,,s,s already 

, „e user wou.d he p.esen.ed a .,s, o.^..ed ^^^^ ^^^^^^ ^ 

shov,n.As«illbedescnt«d.n . .^^^^ ^^„„g^ 

distin..- ... ne«.een are provided .or 

assigned by .he sys.en,. Separate -'^J' ^^'^ ,,,,3 had been 

user ratings 7, and predicted '^'^ '^J^^ o. all rated 
- rated, the user vould ^ J - P'-- 

actors, both u»»r— i. -" '^ „„„ and the, may revrse 

ratings. Th . -.e user may ,^ oorrec, predicted 
predicted ratings. A-vantageously. the^^ 

ratings a.lows .he use, to b^wse he basis ^^^^ ^ ^ 

,5 system .0 make a paiticular p,ed«..on .or a sh . ^^^^ 

direcly modily his or ha, ^ S and 9 show, the 
:re:srra:r:r:— ng..e-P™gramsisa.mostident^^^^ 



to that for actors. 
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...screensarenotsho«n.o.a,,a«r..^^^^^^^^^^ 

and correcting them is vWua.^ ^^^^^^ .actors.- 

anribu.es The preterred embod,men^< 
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e„„venv,.na. ~es °. c.n^ ^ ^ 

commonly kno«n to those skUlM 
so«»a,eeng-,neonng, and user ■n.ertacedos.gn. 

. ^ a P.e.erenoe p-otile is b.m. the user may explicitly 
AS described above, as a preteren v ^^^^^ 

programs and Individua, P™^-"- ^"^ J Cher system heuristics 
..e, .heir own, or pred^d '^^^^^^^Z' ^ ...cs a program 

"^^^-"•^^r/r ^err— ally assigns one thumb up^ 
,„ bo recorded, the system ^ ^ad no. already rated 

corresponding .o a raHng o. one. * ^ ...s watched 

,he program, omer heuristics are based on whe*er 

alter ,, was recorded, and for how long. 

^ PREDICTING P«OUH»« PATINes 

„cnes .he sys.em his o, her preferences 
As prev,.u.., - ^ «„h, and rating 

rran:o:rd genre. Subse,uen.,y. .he 
20 individual program elements, su* ^^^^ ^^^.^ ,^„„g, 

P'"--^;:::"": us^ «ng ,hem. The preferred 

inches . co.labora.ive filtering algoh,hm and 
a con,en..based adaptive modeling alflom,.,. 

a pool, or a population of ..ems. As p. 

^ " Z iTrZl — asl number of .humbs 

embodimen, of the invention, .he ra..ng ^^.^^^ ^ „ 

30 „om .3 .o 3, wl.h 0 conncmg a nei^^a^^ng^ ^^^^^ ^^^^ 

populalion o. program elements. ■>"«="";^; " J 
Led by me user according .o the same rahnfl system. 
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COLLABORATIVE FILTERING 

0-' :X . ol-l Z cnucH .He cu.en. use. v.., 

,i,e a p-ogram.o belted, Fnend^ ^^^^^^ 

thumbs up for Fras.er. a correlating items table 

''°"^"^.^::::rnXra::.r^^^^^^^ 

7 SeinI - ,h>ny*ee pe, can. co.e>a.ed. Msun,.ng . a. 

, r!::::r;r::L««Uonis«.a..euse,v.»Ke.p.,e„a. 

to the extent oi ^ uiumb" 

. -••^c the following 

The invented implementation of collaborative t.K.. . 

advantages: 

— Cra"rsTrs::: pe.o„a, .e. 

« be.ee„ p.. o^ P-^ ; cn U,e se^a. P.,e.encas 

inlo,ma.,on « h«P P"^^" '™ ^^^^r has an anonymous sal o. 
„e^«ork oonnecHon Is lann^ated, the sender 

J -,^«'t matter whose preferences they are. 



, Distributed, o ted thaV. oredictors oi 

„„ers *ese pa.« » «,e use.. Thus, co 

. u o rated neither Spm y ^^^^er i^anu, 

hand has ratea ^^^^^ pa,r. un 

- -weld "-^^ 

-> Frtends 0.661 ^ 

.4^ \t% the coUaborai 
andusedas.nputstothe ^ 

. twp coUaborative -"ennQ pairs ot 

^ra correlation, a comn 

\t •'omp 

shows so . ^^<^ed. 

p^ess..ora«pa,. -V ^^^^^^ 

'aaon. from serve, ^ 
Vou- '""9 - (ems are broadcas. 

;„*.lons b,e««e„ pa,rs ^ ^^^^^ e.,r..o.. 

, dr diont or«:y froc'*^ -aaybas.- 
„ecessiWolrecc«pu.in900r. 

• engines* 

3„ 5. "•^'•t!r„„hec=.«abor.«ve«>' *9 ^^l^, „o^=««»l -or - 
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«t its feeder computer, and the process .s 
computer wU. queue up at rts feede P 

aeiaved so.ew.at without a "-^f^^^^^^^^ ..atly .om 

,ser. AdditionaHy. since --'^^^^^^^^ .esuUs in a 



15 



, ,he functional architecture o) a distributed 
Figure to provides a diagram o. «, un^- ^ 
collaMratlve lilteHng engine. -"-"'J^;^ ,2. As 

intermittent contact «Hh a ^e implemented across 

indicated above, the ~ J, single computer having 

severat computers, or it may be '-^^^'^ i„«„,,o„. the 

„.,ip,e .unctiona, ^^rliion over publicly av..ab,e 

^etworK connection ,s ^ ^'^ J However, other types 

.eleoommunicatlons networKs " " within the spin, 

o, netwo,. connections ^,,„„3d embod^en. o. the 

and scope o. the inven«on. Accord,^ o th P , 
invention, the Cent ,0 ;;;:;,3„.mi, rated items IS to the 

period on a daily basis so that ,„,adcas. (rom the 

, Ln,er „ and recede - ^^^^^ te, wherein the unrated 

^n,er t1 pertodically. A .,s.,ng o. unra ed ^ ^ ^^^^^^ ^ ^ ^ 
ilems consist ol television prograrns. ,s display means 

unrated programs is P--^'^'^^ ; . .^n, A CBT monitor, an LCD 
25. The display means may During the period o. 

„ dismay, or any other generalty .^wn , .„ 

dally contact with the i.^^. Known to the user 

interactive user inteHace 14. ^^^^ ;',^,,,,ed. As «ems are rated by 
„,ngthe graphical rat.gsys^m p.v, "J^ ^ ^^^^ ,„ ^ 

,he user, the rated items are save .^^^ ,^ ^^^^ 
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When «,a o„en. 10 ana «,e se.e, 1 , are », —cation. ,he ,1s, c, ra.ed 
„ems 15 is ttansmitted to .he serve,. The oo,.ela.,ng ,.enrs .able 104a ,s 
^neraleo usln, .he ra.ea «e.s 16 Inpu. o. al, users, or a ran.cn, sa.p e 

A frequency ..«er 101 blocKs Herns and pairs o. «en,s ,ha. ha e no. 
Tn ra.ed\y a su«en, number o. users, ,hus mlrilnil.n, . e s.r . 
required lor .he pair ™a.nces 102. The .«.er .hreshclds also serve .c assure a 
:l„n. qualHv o, .he correla«on calcula«ons, since .hev ge. .ore accurate 
«.«h more inpu, due .o ,helr adapttve na,ure. FlKeHng ,a.es p ace ,n .wo 
Z The .rs, s,age .racKs «ie frequency o, any unique -en,. 1, .he 
^ anH ■-.^ laling are no. considered. The 

'"'"T. " InKois 1 o< unique pairs. « a pal^s frequency Is 

second s.age monrtors 

,00 low, .he pair Is no. longer considered. 

Pair mainces s.ore .he user ra.lngs in an „ by „ ma.riK, where „ Is ,he nun*er 
. o, lie. levels on .he ra«ng scale used by users. As previously descnbed 
' 1 en,boc«„«n. o, ,he Invenl^n, ,here are seven dlscre,e, ra,,ngs. 

* , 0 1 . 3. Thus, each pair -,n. is a 7X7 ma,rtx. The foregoing 

' ' ■ . H«rf - . llmiV 'a,ing scales. resuBlng in 

aesdr,p..on is no, m,endea l,m., . 

0 ma.rloes o, Che, -enslcns are also su,«ble. 
algorithm for s,orlng raUngs ,o me pair ma,rlces 102: 

Ge. a pair of ratings for a pair of items. 
Find the matrix for u,.: r»ir. and crea,e i, 1, does no, exrM ye^^ 
using the rating pair as index ^to «ie matnx, foca.e the cell for .ha. 



1. 

2. 

25 3) 



rating pair. 

4) Increment the cell's value by one. 

5) Goto1. 



30 



factor from approximately -1 to 1. 
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, „=r 10S oravents pairs of items from being considered thai 
The correlation Mter Prevents ^^^^^^ 

TreXt ra L "Lin «.er t03 are assa..ed into 
not used. Those pa, s ma p ^^^^ 

::::rTe:rtro;apa..ne«o...d,s.r,.^^ 



in 



10 



, . ,ide a predictive engine assigns a rating to a new unrated item 

^ "'tre o. — '° "^^^ °" 

, p„ .ve ^^^^^ ^^^^ .^^ 

r :n ;::.Z=ov. ' an a,gor«.m tor rating an unrated .em. 



3. 

20 

4 



1 Get an unrated item (progran .;. 
,3 , . ,rcn .or me Item in the correlating «ems table. 1. no, .ound, no 
predict.- - "lade • Goto 1. 

. . tor an correlating items ttie 

Create a wort< list of correlation factors for all 

user has rated, together v«lh the user ratings. 
„ ,he worK list is empty, no prediction is made. Go to 1 . 
Make sure tl,e work list contains a fixed number of items. 
■ t H tne work list exceeds the fixed number, remove those that 

rwVe::rn: rdiJn. unrated „ems. When the amount Of 

data available for prediction vanes, 
e. Thesumo.C.a.ing-correlation,.a,.itemsinthewo.k,ist,di,K.edbv 



wooiMias^ factors ior a« «ems 

,he syslem « *''«"^ more prog«ms 

aesCbeO .Oov- *^ over «n,e - ,^ 

, «ted. ^^men » P';'"'^^ „ „o Pair M..nces Jo 

.ocuraoy and scope ^ „ ,o do ^-^^ ^^^^ s,„e 

„ou,d be«ansm«ed.o.ha nee ^^^^ 

,5 ,0. each Cien, and .den J ^^^^ _^ „„ 

«„enaccep«n9«P"'-^ same .we «.ndov. to ^.^^^ ^^^.e., 

;.ndon.W ,0 ad*«on, me ' aWidW a« 

,0 Keepins j;^, >ne counts. No,n«.«a«on n ^„ 

' ,epe«we inp.* W ; counts constant, a J ^^^^ 
oounts a <aCer *at K^P ^.^^ ,3 me c.^« 

„„cnan,>n9 ». ra,^ - .,o«.V a*>P^ , „p,„ion 

,,,..r«s>e -nts o ^ ^ te>ev*n 

,5 and oor.etet»n .a^« ^ ^^aua. sh« J ehanae. »"« 

among users changes. S ^^^^^.^^^ ^"^ ,ess l«.e others. 

.,ewe,s occurs "'^^^^^ some prograrns and h^- J^^^^ 

,,ogramhec«.^«-^^,,,,corre.^^^ 
,„o«ec,/.a«<^ >^ ,,„,„,.s ratings. 
30 actual*angestoaP 
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As Wieated previously, items ma, be rated by one ol two algorithms e«her 
.^IboratL filtering algoHtbm described above, or an adaptive Itenng 
aigoritttm incorporating a naTve Bayes classltier, described ,n greats e 
Jrein below. It Is has been empirically dete^ined tha, col,abora.,ve „lter,ng 
. rmorereliablepredlctoro,«ems..atareliKely,oappea,.o.eus.tba^^ 

,he adaptive filtering algorithm. Accordingly, it .s preferable that 
l^rTtive fi«er rates an «em. However, in the absence of coiiaborat,ve 
Lng data, a heuristic passes invokes the adaptive fiitenng aigonthm^ 
dborative ffltering data may not be present if the Cient has been una^ 
„ ,o contact the server. The adapUve modeling algorithm worths by us ng 
Zlasad nHering. In pari^lar. K uses a program's features and the 
I'sprevlousfy expressed preferences on Individual program features to 
al 'ra prelcion of how much the r.er would ii.e the program. As 
pILsly noted, programs may be desc,»=ed in terms of auributes: actor 
,5 7e and director, for example. General^, each attribute may have seve. 
les. For in^ce, 'genre- may have any of several hundred values; actor 
iThave any of several thousand values. Each individual value, or 
Ilue pair, may be seen as a d^nct progran, feature. Thus genre: 
Tuln com^' is a feature; actor;-Jennlfer Anniston' ^ anomer feature. 
.0 0~e teaching phase, the user may have ""Ife-r^^^^^^^^^ 
..umb up and ■situation comedies. 2 thumbs up. Based <^^ . he u e s 
expressed preferences, arui program lnfom,al,on from the TRIBUNE MED 
SeCcES (TMS, database, which indicates that the genre feature fo 
trie!ls- IS LaL corned, and the actor feature is Jennifer Anniston. 
25 the system would assign f thumb up to -Fnends." 

in the example above. It is worth nolina that. In the presence of an actor 

11 assigned the program 1 thumb up, rather than 2, ,nd,cat,ng that ha 
Trling was weighted more heavl^ than the genre rating ,n pred, t ng 
" Cram rating. A feature's specin^ is an imporian. — -'^ 
llht given to « In computing a program rating, ft is ^PP--'- J^^; 
Lsidering a population of features for a poo. o. programs, a specific actor 

^0 
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WOOt/47257 ^^^^ ^^^^ ^^^^ple. 

.e actor .ennUer Aston' -"'^J^^^^^^^^^^ ot teatures. and occurs . a 
A • Thus H a feature is rare .r. a pop ^ population, rt is 

^eavl-v «e.*<ed *^ ' „,V occur acrc^ ^, 

:::it:e-a«e,.e...-W.a.ac..,o. 

.V *e J,,l,e,ancas.W.enmeadap»vamoaa.^^^ 
expficitJy rated eve program. »n the ao 

. -4 'mature is employed to coir.^ ^^^,^g a 

the one rated .eature asstgns an ov . ^.,,,es 

.,a.e. Keeps a .a„v ^ .„ ..e - W - - - 

popu,a«cn o. ,a,ea -^^^ ..^..na aenn«e, ^nn,s.on wo 
example, a use. may ra<e a P 
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up. Anc,he, program wHh ar,o,her aco, may be rated one thumb up^The 
svstem keeps a tally o. the r,umber of times a feature occurs ,n the 
Culn f rated programs, and what raf.g the program reca.ved and 
lis an lnte,«gen. oonCusfon about the .gni„oance of a fea fha 
user based on the feature oocurre,v>es and the ratrngs. Thus. ,f the 
p^^t^n of rated programs, Jennifer Annfston occurred ten t,mes. ea h 
r« a program receiving two thumbs up, men the probab,i„y wouid be 
Z L other program she occurred in woufd recede two thumbs up. 

A stepwise descripuon o, a nafve Bayes Cassifier, according to the invention 

riLted above, a poo, of items (programs, e.s.s. The user o, .he 
1 m assigns ratings to a subset of «tat poo, using a discrete number o 
:^s ,n the preferred embodiment, the rating is expressed as a number of 
-Iwn. corresponding ,o ratings of -3 to 3; to avoid amb,gu,.y 
■ being 'O' is omrne- fro,, oa^uiat^s. Tfte iten-s are desoHbed in ,em,s o 
pi I d atfrtbutes. ... -P'- - -in actor, the genre the yea he 

anguage. the time It IS aired, the tv 

::luTbrrrhrrio.Khl. ^viewed.andsoon^.ach 

„ ritmayhaveapiuraiityofvafues. / 
vector C. is defined (C„ is the first attribute. C, .he second, C, the .h,rd 

25 occurrence. A -P--' ^ ^^^^^^^^ ,3^. 

Hems that receive a parfc^-at-ng^ feature vector for feature . a .s 
Where P is a prediction vector. C, ... C„ «s tne lea 

ratinn levels p is calculated according to. 
the global vector and there are m rating levels. 
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r,(iVc,(O 'C,0>-C„(l) 

p(2)= -^^^ --^i^y 



, , ^/^.-.wr.(.,-i)*c,(m-i>-c>.-i) 
PC"' - 0= - — ^ mji^ 



^ ,a«ng Where P shows a .ax,.um va,ue ,s .he ,nos. probate ,a«ng ,o, 
The «Hhu«on o. .e values ,n . ,s an >n.K..or o, ce«a»>.y. 

° ,no.e.car,h,p— s..ena,VeBaves^.^^^^^^^^^^ 
,ve.ya«ribule, only one value ....y 
„e,.I ,o, a progran,. multiple values ma, occur 

example. ^ ■ ... ~ — p!;l o, 

-"^^ ^'-"^ aix^-rr rr tz a. 

rare^ar;; ana cas. vectors ,or .hose features Iha, occur 
collapsed ,n,oag rega.e«e ^^^^ ^ ^^^^^ 

in the program to be raieo. 

->re. 

ratings, two attrit ''3'^ 

20 ^. xt-e method of collapsing, or 

. .«o ."Hhu.es are d».eren. In n , a -J m ^^^^^^ 

comhining a,, alues .or an a«n u.e • — ' ^ ^ , 

^..mt *»d *e Dopu atlon oi qenre 
vectors are sums. ea. me 

hundred separate values. Due .o *e lar, Popu la J 
,5 and possW numhe.ng in the ten's o hou s o ^h y 

tytawng maximum fte<,uenoy a. each ratmg level, 
are often clustered. 



5 



, a measure o. coo(.dence „, 

^ „en«one<i above a ^ " «.a«. 

i„.aa*« - . ^ - .o ...... 

,„,„g>hesvalem.>ven ot values, a"" ^^^^^d on 

;"uoeae.«--'"-:';eco^^^^^^^^ 

Uoonoa .a«n«^;; -^-^'J ".es an. a. a,a 

,„oun* o. evidence ^^^^^ ,„ a« fle , 



\5 



:„„n. o, evidence ,0, ^^^^^ all «en,J . 

^ >. a« coun = . J an^ov.^ o^^ 

.„n,med. vs. value « ca ^^^^^^ ,or 

,galns. HW so ^ " ,,,o,s ^ in *e arty ^ ,3Place 

"we * a mo.e sensible ^.ere me,e « ve^ 

evidence 9ro>NS. ^,gorilhr. »s me 

.!a,ua,ed. « *e '^7,^>c. a ,a«n9 <o. mose . 
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,ea,u,es. a a,odi«ed oaTve Ba,es olassffle, calculates ,ha o, p,obab»i.y oMhe 

» P^HIcu,. ...n,. us., .ea.. ^^^^ 

aeld from previous use, ^Hngs o. programs. A probab„«y vector aUows a 
cootidence level to be expressed for the predicted ratmg. 



DISPLAY OF BATED ITEMS 

AS Figure 2 shov«, rated Items are displayed as a lis. of suggestions. Both 
0 uL ated-«ems and items oanying predicted ra«ngs are tisted in the same 
dsplay AS previously described, user ratings are differenbated from 
ried ratings through the use of dis«nct ratings icons. The output rom 
,„,b prediction engines, the ooiiaborative filtering engtne and the con e 
bid engine is scaled and integrated into the same list. As prev.ously 
„ drs^ b^d me ratings range from three thumbs up to ... thumbs .o.. 
Lhree thumbs up being most favor,.. .... .nree thumbs down be ng 

Lost untavorable, ....-^ndlng to discrete numerical ratings ,n a range o 

^3 Tfo, <»splav, the Kerns are sorted in descending onfer from m^ 
,1 rable to leas, favorable. W«,in each dtecrete rat^g. U,e Hems are sor^^d 
,„ descending order according to con«dence of the pred,ct,on, the 
" irce leL ranging f«>m , to -1. Conf^ence level values .e no 
necessarily discrete values, as the ratings are. It will be apparent that exp W 

rerrZs hav ighes, conOdence level, thus they are listed first w,.h,n 

the ratings groups. 

" Although the invention ^^:r::-:::zz:rz 
r ::::r : sutrd tor those se. tonh here. «... 

departi; from the spirit ^ scope of the present 
30 invention should only be limited by the Claims incH«.ed betow. 
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CLAIMS 



5 What is claimed is: 

1 A method of predicting items of media content most likely to appeal to 
a user and presenting said predictions in a graphical user interface wherein 
said predictions are based on preferences expressed by said user. 
10 comprising the steps of: 

providing a rating system; 

providing a metaphor for expressing said rating system; 

providing an interactive user interface for assigning ratings by said 

user; 

,5 rating items according to said rating system by said user using said 

interactive interface; 

generating ratings of nev. content items according to one or more 

predictive algorithms, based on said user ratings; 

displaying said user ratings and said generated ratings in said 

20 graphical user interface. 

2 .ne„.. of Claim 1. wherein items are defined by predetermined 

attributes, each attribute nav...9 a plurality of possible values, and wherein 
said step of providing an Interactive user interface for assigning ratings by 
25 said user comprises the steps of: 

providing interactive lists of items; and 

providing interactive lists of attributes and corresponding values, 
wherein each unique attribute-value pair constitutes a feature. 

30 3 The method of Claim 2. wherein said step of rating items according to 
said rating system by said user comprises at least one of the steps of 
assigning an overall rating to an item; 
assigning ratings to individual features. 

c2// 
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4 The method of Claim 3. wherein said rating system includes values 
from a range of approximately -3 to 3. so that a negative number signifies an 
unfavorable rating, a positive number signifies a favorable rating and a '0 



5 signifies a neutral rating. 



5. 



The method of Claim 4. wherein said graphical metaphor utilizes 
Ihumbs up- icons for favorable ratings and "thumbs down" icons for 
unfavorable ratings, and wherein the number of thumbs assigned to an .tem 
10 equals the numerical value of said rating. 

6. The method of Claim 5. wherein said step of generating ratings 

comprises the steps of: 

providing a collaborative filtering algorithm; 
, 5 identifying new Hems that correlate highly with items previously rated 

by said user, according to said collaborative filtering algorithm; and 

assigning ratings to said new items based on said correlation and 
said previous user rating. 

20 7. The method of Claim 5. wherein said step of generating ratings 

comprises the steps of: 

providing a content-based adaptive modeling algorithm; 
evaluating user-assigned ratings of individual features; 
assigning an overall rating to a new item defined by any of said user- 
25 rated features based on said user-assigned ratings. 

8. The method of Claim 7. wherein said step of generating ratings 

comprises the steps of: 

providing a modified naive Bayes classifier; 

pooling all features defining items assigned overall ratings by sa.d 
user, except for featrues that have explicitly been rated by said user; 



An 
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tallying the occurrence of each distinct feature in said pool, and 
weighting it according to the overall ratings of the items it defines, according 
to said naive Bayes classifier; and 

generating overall ratings for new items based on said tallies and 
weightings of said features. 

9. The method of Claim 5. wherein said media content comprises any of 
network television programming, cable television programming, network 
television programming, pay-per-view television programming, movies and 
public-access television programming. 

10. The method of Claim 9, wherein said attributes include: 
genre, actor and director. 

11. The method of Claim 5, wherein the "thumbs up" and "thumbs down" 
icons for user assigned ratings are visually distinct from those for generated 
ratings. 

12. The method of Claim 5. wherein confidence level of said predictive 
algorithms increases as the number of explicit ratings increases. 

13. The method of Claim 12, wherein the step of displaying said ratings 

comprises the steps of: 

aggregating said user-rated items and outputs of said predictive 

algorithms into a single list; 

sorting said list according to rating in descending order; 

sorting items haying the same rating according to confidence level in 

descending order; and 

displaying said sorted list in said graphical user interface as a list, 
wherein an item is displayed accompanied by its rating icon. 

1 4. The method of Claim 1 2, further comprising the step of 
changing a rating by said user; and 

olg> 
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inpuumg said features 
a,goh.hm,a,es items no. P«V.ous,„a.ed. 

ojri ^Pcond algorithm includes a 
TVte memoa o, as. Baves c>ass«e, 

ratings and generated ratmgs compnse P 
, :;<p« rating oventdes an -.n-p^raung. 

^ nrat^od o, Cain. --J:n;r*d 
^ciudedasinputstosaidBaves .^^^^^^^^^^ 

„i,h unrated features, sard unrate 
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modify said list comprises providing an interactive user interface, wtierein 
each attribute is displayed as a user selection on a screen, wherein 
selecting an attribute navigates the user to a subsequent screen displaying 
one or more lists of values, wherein each list is a user selection. 

5 

31. The method of Claim 30, wherein said step of presenting said user 
with a list of said attribute-value pairs so that said user may interactively 
modify said list further comprises the steps of: 

selecting a list of features, wherein features constituting said list are 
10 displayed on a subsequent screen; 

evaluating ratings assigned to said features; and 
optionally, modifying said ratings. 

32. The method of Claim 16. wherein said media content comprises any 
15 of network television programming, cable television programming, network 

television programming, pay-per-view television programming, movies and 
public-access television programming. 

33. The method of Claim 16, wherein said attributes include: director, 
20 actor and genre. 

34. The method of Claim 16. wherein said ratings include values from a 
range of approximately -3 to 3, so that a negative number signifies an 
unfavorable rating, a positive number signifies a favorable rating and a '0' 

25 signifies a neutral rating. 

35. The method of Claim 34, wherein a graphical metaphor expresses 
said ratings, so that a "thumbs up" icon signifies a favorable rating and a 
"thumbs down" icon signifies an unfavorable rating, and wherein the number 

30 of thumbs assigned is equal to the absolute value of said rating. 

36. The method of Claim 35, wherein icons signifying explicit ratings are 
distinct from icons signifying implicit ratings. 

32- 
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optionally, presenting said user with a list of said features so that said 
user may interactively modify said list; and 

inputting said features to said adaptive modeling algorithm, wherein 
said algorithm rates items not previously rated. 

41. The method of Claim 40. wherein said adaptive modeling algorithm 
includes a modified naive Bayes classifier, wherein said modified Bayes 
classifier accommodates multiple simultaneous features, and wherein said 
modified Bayes calssifier is capable of excluding selected features. 

42. The method of Claim 39. wherein an explicit rating overrides an 
implicit rating. 

43. The method of Claim 42. wherein explicitly rated features are 
excluded as inputs to said Bayes classifier so that said algorithm works only 
with unrated features, said unrated features constituting free-floating 
features. 

44. The method of Claim 43. wherein said step of determining features 

20 comprises the steps of: 

aggregating all free-floating features from said user-rated items into a 

population of features; 

tallying the occurrences of unique features in said population; 
assigning a weight to each unique feature, wherein a feature of high- 
25 specificity has a higher weight than one of low specificity; and 

wherein an infrequently-occurring, highly-weighted feature constrtutes 
a reliable predictor of items likely to appeal to said user. 

45 The method of Claim 38. wherein said step of presenting said user 
30 with a list of said attribute-value pairs so that said user may interactively 
modify said list comprises providing an interactive user interface, where.n 
each attribute is displayed as a user selection on a screen, where.n 

3^ 
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selecting an attribute navigates the user to a subsequent screen displaying 
one or more lists of values, wl-erein each list is a user selection. 

46 The method of Claim 45. wherein said step of presenting said user 
5 with a list of said features so that said user may interactively modify said list 
further comprises the steps of: 

selecting a list of features, wherein features constituting said list are 

displayed on a subsequent screen; 

evaluating ratings assigned to said features; and 
10 optionally, modifying said ratings. 

47 The method of Claim 38. wherein said media content comprises any 
of network television programming, cable television programming, network 
television programming, pay-per-view television programming. mov,es and 

15 public-access television programming. 

48 The method of Claim 38. wherein said ratings include values from a 
range of approximately -3 to 3. so that a negative number signifies an 
unfavorable rating, a positive number signifies a favorable rating and a '0 

20 signifies a neutral rating. 

49 The method of Claim 48. wherein confidence level of said adaptive 
modeling algorithm increases with increasing numbers of explicitly rated 



items. 



25 



50 



30 



The method of Claim 49. wherein a graphical metaphor expresses 
said ratings, so that a "thumbs up" icon signifies a favorable rating and a 
-thumbs down" icon signifies an unfavorable rating, and wherein the number 
of thumbs assigned is equal to the absolute value of said rat.ng. 

51 . The method of Claim 50. wherein icons signifying explicit ratings are 
distinct from icons signifying implicit ratings. 
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52. The method of Claim 50, further comprising the steps of: 

aggregating user-rated items and output of said algorithm into a 
single list; 

sorting said list according to rating in descending order; 

sorting items having the same rating according to confidence level in 

descending order; and 

displaying said list to said in a graphical user interface. 
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<r Teach TiVo 



TiVo's Suggestions 



News Channel 11 at Thu 12/2 

ABC 7 News at 5PM Thu 12/2 

Maury Fri 12/3 
The NewsHour With Jim Lehrer Mon 12/6 

Charlie Rose Fri 12/3 

Martha Stewart Living Sun 12/5 

Real Science! Thu 12/9 




24 



FIG. 2 
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Teach TiVo 

^ — ^ 

Teach TiVo lets you Thumbs rote programs, actors, 
directors, end categories of shows. This information is 
used to improve the suggestions in TiVo's Suggestions. 



Teach Categories of Show>] X 



Teach Programs -^32 
Teach Actors 
Teach Directors 
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FIG. 4 



Teach Categories 

^sub-category 2 
sub-category 3 
^ sub-category 4 
£ sub-category 5 
^sub-category b 
1^ sub-category 7 
^sub-category 8 
^sub-category 9 
^sub-category \0 
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Teach Famous Actors 



fGrit 



, Ford, Horn son 
^ Gere, Richord 
^ Griffith. Melanie 
^Nicholson, Jack 
^ Ryan, Meg 
^ Segal. Steven 
^Thurmon, Uma 
V 



FIG, 6 



Correct Rated Actors 
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Correct Rated Programs 
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^0 programs hove yet been rated. Each time you give a THUMB UP o^ 
THUMB DOWN to a progroiD, the actors, directors, cotegories of 
thot progroni get thumbs too. You can thumbs role program in lots 
of pieces: in the chonnel banner, program guide, ond ony program 
inforfflfltion screen. Once you've roted a progroiu you will see a 
thumbs like this: 

If TiVo guesses your opinion of o progran, you will see thumbs like 

this: 
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